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Abstract — Stochastic network calculus is the probabilistic ver- 
sion of the network calculus, which uses envelopes to perform 
probabilistic analysis of queueing networks. The accuracy of 
probabilistic end-to-end delay or backlog bounds computed using 
the elegant theory of network calculus has been always a concern. 
In this paper, we propose novel bounds based on Doob's maximal 
inequality for N-demisupermartingales to compute end-to-end 
probabilistic bounds which improve the existing bounds from 
network calculus. In particular, we show that reasonably accurate 
bounds are achieved by comparing the new bounds with the exact 
results from queueing theory for a network of M/M/I queues. 

Index Terms — Network calculus, end-to-end delay and backlog 
bounds, Doob's inequality, N-demisupermartingales. 



I. Introduction 

QUEUEING theory is the mathematical study of queues, 
which generally uses probability mass or density func- 
tions to describe arrival traffic and service offered at the 
network node to compute exact probabilistic delay or backlog 
measures. However, with few exceptions, stochastic analysis 
of queueing networks using queueing theory to compute end- 
to-end probabilistic performance measures is mathematically 
complex without making simplifying assumptions on arrival 
traffic or service offered at the network nodes. In most 
situations, probabilistic bounds on performance measures are 
as sufficient as the actual values. Stochastic network calculus is 
an elegant theory, useful for computing probabilistic bounds on 
end-to-end delay or backlog in queueing networks. Stochastic 
network calculus is the probabilistic extension of deterministic 
network calculus, which uses an envelope approach to describe 
arrival traffic and service offered at the network node. The 
tightness of the end-to-end probabilistic performance bounds 
has always been a concern in stochastic network calculus. 
The concern is mainly due to the use of union bounds for 
computing the bounds on probabilistic performance measures 
of the network. Recently, in 1 1 1, |2|, authors have derived new 
performance bounds for a GI/GI/1 queue in stochastic network 
calculus using Doob's maximal inequality for exponential 
supermartingales (instead of using union bounds) which are 
comparable, to the exact results of M/M/1 and M/D/1 queues 
from queueing theory. A general comparison of results for 
GI/GI/1 queue from statistical network calculus with the 
classical queueing theory is made in Q. 

In this paper, we compute end-to-end probabilistic perfor- 
mance bounds for a network of GI/GI/1 queues in stochastic 
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network calculus using Doob's maximal inequality for N- 
demisupermartigales [4|, |5|, which yields similar results as 
in m, ill for the single queue case. The rest of the paper is 
structured as follows: In Section HI] we introduce the notion 
and assumptions used in the paper In Section |III1 we derive 
the probabilistic end-to-end performance bounds on delay 
and backlog using the notion of effective bandwidth f6l and 
effective capacity |7| functions under the stated assumptions. 
Brief conclusions are presented in Section |lVl 

II. Notation and Assumptions 

Our time model is discrete, i.e., i G No = {0,1,2,...}. 
We assume that the arrival traffic and the service offered at 
a node are stationary and have independent increments, i.e., 
the random process depends only on the length of the interval 
{s,t] (A = t — s) , but not on s or i itself and increments 
over two non-overlapping intervals are independent of each 
other In a network of nodes connected in series as shown in 
Fig. [T] we use non-decreasing, left-continuous processes Ah 
and Dh to describe the arrivals and the departures at node h, 
respectively. Ah{s,t) and Dfi{s,t) represent the cumulative 
amount of data seen in an interval (s, t] at input and output of 
the node h, respectively, for any < s < t. For the arrival and 
departure processes at node h, we assume the initial condition 
Ah{0) ~ and the causal condition Dh{t) < Afi{t), where 
we denote Ah{0,t) = Ah{t) and Dh{0,t) = Dh{t) for any 
t > 0. The backlog Bh{t) and delay Wh{t) at time t > in 
a node h is given by Bh{t) — Ah{t) — Dii{t) and Wh{t) = 
mi{d > : Ahit - d) < Dh{t)}, respectively. 

A stochastic service process Sh is said to describe the 
service offered at node h, if the corresponding arrival and 
departure processes at node h satisfy for any fixed sample 
path and t >0: 



Ah®Sh{t)<Dh{t) 



(1) 



where ® is the min-plus convolution of Ah and Sh which 
is defined as Ah ® Sh{t) = mia<u<t{Ah{Q,u) + Sh{u,t)}. 
Any random process S satisfying the above relationship is 
referred to as "dynamic F-server" in [8|. The main advantage 
of using network calculus to do performance analysis of 
networks is that the network calculus allows to model a 
network of nodes as a single virtual node. The stochastic 
network service process Snet characterizing the service offered 
in a single virtual network node, which represents a network 
of H nodes connected in series as shown in Figd] can 
be computed for any fixed sample path using the min-plus 
convolution of the stochastic service process Sh of constituting 
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A = Ai 



Fig. 1. 



D, = A2 



Dh-1 = Ah 



Sh 



Dh = D 



Network of H concatenated nodes 



nodes for h — 1,. . . ,H, i.e., Snet ~ Si (S) S2 ® ■ ■ ■ ® Sh 
im, im, ifTOl . Since we assume the arrival traffic Ai at the 
ingress of the network and the service process Sh at each 
hop h to be stationary with independent increments, we have 
Ai{s,t) = Ai{0,t~s) and Sh{s,t) = ShiO,t ~ s) for any 
t > s > 0. We assume that the arrival traffic Ai at the ingress 
of the network and the stochastic service processes Sh, for 
h — 1, . . . , H, characterizing the service offered at the nodes 
of the network are independent of each other. 

To compute the probabilistic performance measures using 
network calculus, we use the notion of effective bandwidth 
(ail) |6| and effective capacity (Ph) El from large deviations 
theory to describe the stochastic arrival traffic and service 
offered at a node h, respectively. The effective bandwidth of 
an arrival traffic Ah with independent increments from IS), for 
any d,t > 0, is given as 

ah{0) = ^\ogE[e'^'^^^^] (2) 

Similarly, the effective capacity function of a stochastic service 
process Sh with independent increments, for any d,t > 0, is 
defined as 



1 



■ log E e 



(3) 



III. Probabilistic Bounds on Backlog and Delay 

In this section, we compute probabilistic bounds on backlog 
and delay in a network of H nodes as shown in Fig. [T] using 
Doob's maximal inequality for N-demisupermartingales. Let 
Ai = A and Dh = -D be the arrival traffic at the ingress 
of the network and departure traffic from the egress of the 
network, respectively. 

The following theorem provides the probabilistic bounds 
on end-to-end backlog and delay using the notion of effective 
bandwidth (a) and effective capacity {/3h) of the arrival and 
service processes at each network node h, respectively. 

Theorem 3.1: Let the service offered at node h in a tandem 
network be modeled by the stochastic service process Sh 
with the corresponding effective capacity function f3h, for 
h = 1,...,H. Let A be the arrival process with effective 
bandwidth a and D be the departure process from the tandem 
network with H nodes. Then we have the following bounds. 

1) Backlog bound : The probabilistic bound on the backlog 
in a network, for any t > 0, is given by 



H-l 



P{B{t) >x]< e-^*^ ^ 



h=0 



h\ 



(4) 



2) Delay bound : The probabilistic bound on the delay in 
a network, for any i > 0, is given by 



H-l 



P{W{t) > d} < e-^*"(^*)^ ^ 



h=0 



h\ 



(5) 



where 6* = sup {61 : a(e) < mmi<h<H {l3h{0)}} 



The proof of the theorem relies on applying Doob's maximal 
inequality for N-demisupermartingales to compute probabilis- 
tic bounds. The key observation is that the random process 
Z{t) A{t) - S{t) and the exponential function e^^'*^ of ran- 
dom process Z{t) for any t > are N-demisupermartingales. 
This is shown using the following lemma. 

Lemma 3.1: Consider an arrival process A with indepen- 
dent increments at a node offering a stochastic service char- 
acterized by a service process S with independent increments. 
If Z{t) be a random process defined as A{t) — S{t), then 
the random process Z{t) and the exponential function e^'^'*) 
of random process Z{t) in an interval [0,<] for t G No = 
{0, 1,2,.. .} and any 9 G (0, 9*] are N-demisupermartingales, 
where 9* = sup {9 : a{9) < /3{9)}. 

Proof: Let a{t) and s{t) be the random amount of arrival 
traffic and data served at a node, respectively, at a time instance 
t > 0, then A{t) = ELo«H and S{t) - ELo^C")- 
Let z{t) = a{t) - s{t) and Z{t) = A{t) ~ S{t). Since the 
arrival process A and the service process S are assumed to 
be independent and have independent increments, the random 
process Z{t) will also have independent increments. The sta- 
biUty conditions for the queue at node are i?[a(l)] < ii^[s(l)] 
and a{9) < (i{e) for any finite 9 G (0, 00). 
To prove that Z{t) and e^^(*) for i G No = {0, 1,2,.. .} and 
any 9 G (0, 9*] to be N-demisupermartingales fU, jS], we need 
to show that E[{Z{t + l)- Z{t))f{Z{l), Z(2), . . . , Z{t))] < 



and E[{ 



0Z(t+i) _ „ez(t) 



)/(e 



ez{i) p0Z(2) 



..,e 



ez{t) 



)] < 



for i G No = {0,1,2,...} for every co-ordinatewise non- 
decreasing, non-negative function / whenever the expectation 
is defined. 

E[{Z{t + 1) - Z(t))/(Z(1), Z(2), . . . , Zm 
= E[z{t + l)f{Z{l),Z{2),...,Zm 
= E[z{t + l)]E[f{Z{l),Z{2),...,Z{t))] 
= E[a{t + 1) - s{t + l)]E[f{Z{l), Z(2), . . . , Z{t))] 
= {E[a{l)] E[s{l)])E[f{Z{l),Z{2), . . . , 
< 

The inequality at the final step is due to the stability condition 
-£'[a(l)] < E:[s{l)] and / being a nonnegative function. 
Similarly, 



E[{, 



__,ez{t+i) _ 0Z{t) 



ez{i) oz{2) 



JZ(t) 



)] 



= S[(eWi) „i)/*(ee^(i),efl^(2)^...^e''^(*))] 



)] 



< 



The final inequality is due to the stability condition a{9) < 
P{9) for any 9 G (0, 00) and /*(e«^(i), e«^(2)^ _ ^ ^QZ{t)^ ^ 
gez(t) j^gez(i)^ gez(2)^ . . . , e^^(*)) being a nonnegative func- 
tion. ■ 

Since {e^^(*',t > 0} for any 9 G (0,6**] is a non-negative 
N-demisupermartingale, by Doob's maximal inequality for N- 
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demisupermartingale from IS, Q we have, for any cr > 0, 

p\ sup Z{u)>a\ = p( sup e''^^''^>e^ 

[T<U<t J [T<U<t 



< E 
= E 



E 



-6S{t) 



The final step in the above equation is from the definition 
of e* = sup {6* : a{e) < l3{9)}. The proof of Theorem [TT] 
also relies on Lemma 4.1 from ffTTI , which states that for any 
two non-negative independent random variables F and G with 
P(F > a) < f{a) and P(G > a) < g{a) where /(cr) and 
g{a) are non-negative, decreasing function for any cr > 0, then 



P{F + G>a}<l 



f{a - u)dg{u) 



(7) 



where /(cr) = 1 — /(cr) and g(cr) = 1 — g{<T). 
Proof of Theorem \3.1\ We first prove the probabilistic end- 
to-end backlog bound. For any fixed sample path and i > 0, 
we have 

P {B{t) >x}^ P {A(t) - D(t) > x} 

< P{A{t)-A®Snet{t)>x} 

= P{A{t)-A(»Sii»S2'»---®SH{t)>x} 

= pI sup {A{t)~A{ki)~Si{ki,k2) 

lO<ki<k2<k3<---<kH<t 

~S2{k2,k3) SH{kH,t)} > x} 

< p{ sup {A{ki) - Sniki)} 

L0<fel</£2 

+ sup {A{ki,k2)-Sh{ki,k2)} + --- 

ki<k2<k3 

+ sup {A{kH,t) - SnikH.t)} > x\ 

kH-i<kH<t J 



h=0 



h\ 



For any fixed sample path and t>0, the probabilistic bound 
on end-to-end delay is given as 

P {W{t) >d}^P {A(t - d) - D{t) > 0} 

< P{A{t-d)-A<S)Snet{t)>0} 

= P{A{t-d)-A(g)Si(E)S2^---(E>SH{t)>0} 
P{ sup {A{t - d) - A{ki) 

d<ki<k2<k3<-<kH<t 

-Si{kuk2) ~ 52(fc2, fca) SnikH, t)} > 0} 

< Pi sup {A{ki)~SHiki)-A{d) + a{0)d}+ 
+ sup {A{ki,k2) - Sh{ki,k2)} + ■ ■ ■ 

ki<k2<k3 

+ sup {A{kH, t) ~ SH{kH,t)} > a{9)d \ 

kH-i<kH<t J 
H-1 



h\ 



For both parts of the proof, the first and second in- 
equalities are due to the definition of stochastic network 
service process and the property of supremum operatiorQ 
ifTTl . respectively. Since (0, fci], (fci, ^2], . . . , {kn-i, kn] and 
{d, ki], (/ci, ^2], . ■ . , (fcff-i, fc//] are non-overlapping intervals, 
{Aik,)-SHiki)}, {A(fci, fc2)-^h(fci, k2)}, {AikH,t)~ 
SH{kH,t)} are independent of each other Therefore, by 
Lemma [TT] equations (|6]l and Q, we get the final step.H 

To analyse the accuracy of the new delay and backlog 
bounds from Theorem l3.1l we compare them with the accurate 
results from queueing theory. We apply the network calculus 
bounds from Theorem 13.11 to analyse a network of M/M/1 
queues. In an M/M/1 queuing system with one server, both 
the arrival and the service processes are of Poisson type. The 
customers arrive at rate A and the server works at rate ^. 
The M/M/1 queue is a birth and death process. We denote 
the utilization factor by p = A//i, and assume for stability 
that p < 1. The effective bandwidth and effective capacity of 
the arrival and service processes (Poisson process) are A *^ 
and p^—§ — , respectively, with 9* = —log p. We consider 
a special case of the network from Fig. [T| with H M/M/1 
queues connected in series to analyse the accuracy of end-to- 
end network calculus delay bound. A Poisson flow with rate 
A traverses through the entire network. The arrival process at 
the downstream queue is the departure process of the upstream 
queue. Let each queue in the network be served by a similar 
service process S with effective capacity /3{9) and the service 
processes at each hop of the network are independent of each 
other. The exact distribution of steady state end-to-end delay 
Wnet in a M/M/1 queueing network from queueing theory is 
given by lfT2l 



H-1 



(Ml_l^M!!p-M(l-p)d 



h=0 



h\ 



(8) 



Note that in the terminology of queueing theory, the delay 
Wnet includes the time spent in the server, hence Wnet = 
Wnet + Snet, whcrcas in network calculus the term "delay" 
is used for the waiting time Wnet neglecting the sevice time 
Snet- We observe that the delay in a queueing system Wnet 
is always an upper bound to the waiting time in the queue 
Wnet, i.e., Wnet < Wnet and by Little's law E[Wnet] = 
E[Wnet] + For 9* — — log/?, we have steady state end- 
to-end waiting time Wnet in a virtual network queue from 
equation (|5]l. 



P{Wnet>d} < 



^ h\ 



(9) 



h=0 



It is apparent from equations dHJ and (|9]l that the probabilistic 
end-to-end network waiting time Wnet computed using The- 
orem [XT] provides reasonably good bounds. 

IV. Conclusions 

In this paper we used Doob's maximal inequality for 
N-Demisupermartingales to compute end-to-end probabilistic 
delay and backlog bounds within the framework of network 

'supo<^<t{X(s) + y(s)} < supo<^<t{X{s)} + supo<^<t{y{s)} 



4 



calculus. The tightness of the computed end-to-end probabilis- 
tic performance bounds is explored by comparing new bounds 
with the exact results from queueing theory for a network of 
M/M/1 queues. 
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